Applicant 
Serial No. 
Filed 
Page 



David Coleman et al. 
10/072,820 
February 8, 2002 
2 of 30 



AttorneWDocketNo.: 16655-002001 



(V 



\ 



Amendments to the Claims : 
/ 

This listing of claims replaces all prior versions and listings of claims in the application: 



Listing of Claims : 

1 . (Currently amended) A method for the processing and displaying of test results 
of one or more tests taken by a plurality of test-takers, the method comprising th e st e ps of : 

(a) obtaining, with respect to each such test, the test itself, said test having a plurality 
of items; 

(b) obtaining the item responses of test-takers taking such test; 

(c) determining appropriate skill categories necessary for a correct response for each 
of said items , so as to r e port e ach of said t e st tak e rs' skill sp e cific performanc e on th e test ; 

(d) assessing the extent to which each item on the test assesses one or more of the 
skills determined in step (c) ; and 

(e) calculating a score for each student's performance in each of said skill categories. 

2. (Currently amended) A method in accordance with claim 1, further comprising 
th e st e p of calculating the scores of a group within skill categories, said group defined as a 
plurality of test-takers. 

3. (Currently amended) A method in accordance with claim 2, further comprising 
th e step of generating evaluation and formative statements for individual test-takers and groups. 



4. (Currently amended) The method in accordance with claim 3, further comprising 
th e st e p of organizing instructional material based on the content of the test. 
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5. (Currently amended) The method in accordance with claim 4, further comprising 
th e st e p of displaying test results and instructional material to individuals. 



6. (New) A method for generating skill by skill scores for individual test-takers of a 
test, the method comprising: 

(a) generating multiple potential skill sets, whereby each skill set includes one or 
more skills tested on the test; 

(b) producing an item skill coding matrix for the test with respect to each of the skill 
sets, wherein each test item is assigned to a single skill of said skill set; 

(c) implementing an iterative procedure in which pedagogical experts and statistical 
experts engage in a joint selection process whereby a single skill set and a single item skill 
coding matrix are selected from among the aforementioned skill sets and corresponding coding 
matrices; and 

(d) applying the selected skill set and the selected item skill coding matrix to each 
test-taker's set of item responses in order to determine skill by skill scores for each test-taker. 

7. (New) The method of claim 6 wherein the item skill coding matrices are non- 
binary and reflect assignments of each item to one or more skills in proportion to the extent to 
which the item is deemed tested by said skills. 
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8. (New) A method for generating evaluative or formative statements for individual 
test-takers with respect to skills assessed on a test, the method comprising: 

(a) obtaining as inputs for a first probabilistic function the test-takers' overall scores 
on the test as a whole; 

(b) obtaining as inputs for the first function a set of skills assessed on the test; 

(c) obtaining as inputs for first function the test-takers' skill-by-skill scores on each 
skill assessed on the test; 

(d) obtaining as inputs for the first function a score-to-statement mapping between (i) 
individual test-takers' possible scores on the test as a whole, and (ii) a set of overall evaluative or 
formative statements used to describe individual test-takers' overall performance on the test as a 
whole; and 

(e) employing the first function to select, based on the inputs obtained in (a) through 
(d), one of the overall evaluative or formative statements to describe each test-taker's 
performance on each skill assessed on the test. 

9. (New) The method according to claim 8 comprising: 

(f) obtaining as inputs for a second function the overall evaluative or formative 
statements describing each test-taker's performance on each skill assessed on the test, resulting 
from the first function; 

(g) obtaining as inputs for the second function a statement-to-statement mapping 
between (i) a set of overall evaluative or formative statements used to describe the individual 
test-takers' possible scores on the test as a whole, and (ii) a set of skill-appropriate evaluative or 
formative statements; and 

(h) employing the second function to select, based on the inputs obtained in (f) and 
(g), a skill-appropriate evaluative or formative statement to each test-taker's performance on 
each skill assessed on the test. 
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10. (New) A method for calculating individual test-takers' growth potential in 
particular skills assessed on a test, the method comprising: 

(a) obtaining as inputs for a first function skill-by-skill scores of individual test-takers 
on each of the skills assessed on the test; 

(b) obtaining as inputs for the first function benchmark skill scores of a larger group 
of test-takers on each of the skills evaluated by the test, wherein the larger group includes said 
individual test-takers; and 

(c) employing the first function to calculate, based on said inputs, a numerical score 
reflecting each individual test-taker's growth potential in each skill, wherein the first function is 
a non-increasing function of the inputs referred to in (a) and a non-decreasing function of the 
inputs referred to in (b). 

11. (New) The method according to claim 10 comprising: 

(d) obtaining as additional inputs for the first function a quantitative calculation of the 
extent to which each skill was tested on the test, wherein the first function is a non-decreasing 
function of said additional inputs. 

12. (New) The method according to claim 10 comprising: 

(e) obtaining as inputs for a second function the numerical scores calculated by the 
first function; 

(f) obtaining as inputs for the second function a score-to-statement mapping between 
(i) the calculated numerical scores and (ii) a set of skill-appropriate evaluative or formative 
statements; and 

(g) employing the second function to assign, based on said inputs, a skill-appropriate 
evaluative or formative statement to each test-taker's performance on each tested skill based on 
the test-taker's growth potential in said skill. 
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13. (New) A method for assigning an appropriate evaluative or formative statement 
in a skill to a group of test-takers based on their results on a test, the method comprising: 

(a) with respect to a single skill, obtaining as inputs all assignments of evaluative or 
formative statements for individual test-takers based on their results on the test; 

(b) with respect to that skill, calculating a number of times each evaluative or 
formative statement was assigned to individual test-takers in the group; and 

(c) with respect to that skill, assigning to the group the evaluative or formative 
statement assigned to the greatest number of test-takers in the group. 

14. (New) A method for choosing an instructional approach in a skill appropriate for 
a group of test-takers based on results of a test, the method comprising: 

(a) identifying a set of potential instructional approaches in the skill; 

(b) estimating the utility of each identified instructional approach with respect to each 
individual test-taker, based on that test- taker's performance in the skill on the test; and 

(c) determining which of the potential instructional approaches in the skill maximizes 
an aggregated utility of all individual test-takers in the group. 

15. (New) A method for displaying test-takers' results on a test administered during 
the prior instructional timeframe, the method comprising: 

(a) obtaining test-takers' skill-by-skill scores or evaluative or formative statements 
with respect to a test that (i) is administered during a given instructional timeframe and (ii) 
assesses a subject in which the class groupings of test-takers for purposes of instruction varies 
between that instructional timeframe and a next analogous instructional timeframe; and 

(b) displaying skill-by-skill scores or evaluative or formative statements with respect 
to those test-takers, wherein displays of such test-takers are organized around class groupings of 
a next analogous instructional timeframe. 
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16. (New) A method for displaying test results, the method comprising: 

(a) providing a printed report that includes test results and related information for one 
or more tests and that includes one or more access codes to enable a recipient to access secure 
accounts on a computer network that contain additional test results and related information; and 

(c) distributing the report to an appropriate recipient. 

17. (New) The method according to claim 16 comprising: 

(d) providing access to the secure accounts via the computer network in response to 
the recipient entering the one or more access codes. 

18. (New) A method for providing results of a group of test- takers with respect to 
multiple skills assessed on a test, the method comprising: 

(a) displaying the results of the group of test-takers in multiple tested skills, such that 
a single display includes names of tested skills and corresponding scores or evaluative or 
formative statements reflecting the group's results in each skill; 

(b) employing an electronic interface to enable a viewer to select a tested skill from 
the display and thereby view another display of the results of the group of test-takers in a single 
skill; and 

(c) displaying the results of the group of test-takers in the single skill, wherein the 
latter-mentioned display includes a list of test-takers' names and a presentation of the scores or 
the evaluative or formative statements applying to each individual test-taker in the skill. 

19. (New) The method according to claim 18 wherein the display referred to in (c) 
includes a presentation of individual test- takers' names, shown in subgroups corresponding to 
the evaluative or formative statement appropriate to each subgroup. 
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20. (New) The method according to claim 18 comprising: 

(d) employing an electronic interface to enable the viewer to select another tested 
skill and thereby view a display of the results of the group of test-takers in a single skill, such 
that the latter-mentioned display includes a presentation of the scores or the evaluative or 
formative statements applying to each individual test-taker in that skill 

21 . (New) A method for providing results of one or more test-takers with respect to 
multiple skills assessed on a test, together with skill-specific instructional materials appropriate 
to that group of test-takers, the method comprising: 

(a) displaying the results of one or more test-takers in multiple tested skills, such that 
a single display includes names of tested skills and corresponding scores or evaluative or 
formative statements reflecting the test-takers' aggregate results in each skill; and 

(b) employing an electronic interface to enable a viewer of the display to select a 
tested skill and thereby view instructional materials relevant to that skill. 

22. (New) The method according to claim 21 wherein the instructional materials 
include instructional materials of a difficulty level appropriate to the test-takers based on their 
performance on the test. 
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23. (New) A method for providing results of one or more test-takers with respect to 
skills assessed on one or more multi-skill tests, enabling the administration of skill specific 
assessments, and displaying the results thereof, the method comprising: 

(a) displaying the results of one or more test-takers in multiple tested skills on a 
single test, such that a single display includes names of the tested skills and, for each skill, 
corresponding scores or evaluative or formative statements reflecting the test-takers' aggregate 
results in that skill; 

(b) employing an electronic interface to enable a viewer of the display to select a 
tested skill and thereby view one or more assessments specific to that skill; 

(c) employing an electronic interface to enable the viewer to choose an assessment 
specific to the selected skill; 

(d) employing an electronic interface to enable the viewer to distribute, to one or 
more of the test-takers, the chosen assessment; 

(e) employing an electronic interface to enable the viewer to collect results of the 
chosen assessment specific to the selected skill, for one or more of the same test-takers; and 

(f) employing an electronic interface to enable the viewer, from a single display, to 
choose to view (i) displays of test-takers' results in a given skill based on one or more multi-skill 
tests or (ii) displays of test-takers' results on one or more assessments specific to the selected 
skill, wherein each of the displays includes a list of test-takers' names and a presentation of the 
scores or the evaluative or formative statements applying to each individual test-taker in that 
skill. 
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24. (New) A method for providing results of a group of test-takers with respect to 
multiple skills assessed on a test, the method comprising: 

(a) displaying overall results of the group of test-takers on the test, such that a single 
display includes multiple test-takers and corresponding overall scores in the test for each 
individual test-taker; 

(b) employing an electronic interface to enable a viewer to select an individual test- 
taker and thereby view a display of that test-taker's results in multiple tested skills; and 

(c) displaying an individual test-taker's results in multiple tested skills, wherein the 
display includes multiple tested skills with corresponding scores reflecting the test-taker's 
performance in each tested skill. 

25. (New) The method according to claim 24 wherein the display referred to in (c) 
includes multiple tested skills with corresponding evaluative or formative statements reflecting 
the test-taker's performance in each of the tested skills. 

26. (New) A system for processing and displaying test results of one or more tests 
taken by a plurality of test-takers comprising: 

a data intake module to: 

(a) obtain, with respect to each such test, the test itself, said test having a 
plurality of items; and 

(b) obtain item responses of test-takers taking such test; and 

a computer coupled to the data intake module wherein the computer is adapted to: 

(c) determine appropriate skill categories necessary for a correct response for 
each of said items; 

(d) assess the extent to which each item on the test assesses one or more of the 
skills determined in (c) ; and 

(e) calculate a score for each student's performance in each of said skill 

categories. 
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27. (New) The system of claim 26 wherein the computer is adapted to calculate the 
scores of a group within skill categories, said group defined as a plurality of test-takers. 

28. (New) The system of claim 27 wherein the computer is adapted to generate 
evaluation and formative statements for individual test-takers and groups. 

29. (New) The system of claim 28 wherein the computer is adapted to organize 
instructional material based on the content of the test. 

30. (New) The system of claim 29 comprising a display coupled to the computer to 
display test results and instructional material to individuals. 

3 1 . (New) A system for generating evaluative or formative statements for individual 
test-takers with respect to skills assessed on a test, the system comprising: 

a data intake module to: 

(a) obtain as inputs for a first probabilistic function the test-takers' overall 
scores on the test as a whole; 

(b) obtain as inputs for the first function a set of skills assessed on the test; 

(c) obtain as inputs for first function the test-takers' skill-by-skill scores on 
each skill assessed on the test; and 

(d) obtain as inputs for the first function a score-to-statement mapping 
between (i) individual test-takers' possible scores on the test as a whole, and (ii) a set of overall 
evaluative or formative statements used to describe individual test-takers' overall performance 
on the test as a whole; and 

a computer coupled to the data intake module wherein the computer is adapted to: 

(e) employ the first function to select, based on the inputs obtained in (a) 
through (d), one of the overall evaluative or formative statements to describe each test-taker's 
performance on each skill assessed on the test. 
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32. (New) The system according to claim 31 wherein the data intake module is 
adapted to: 

(f) obtain as inputs for a second function the overall evaluative or formative 
statements describing each test-taker's performance on each skill assessed on the test, resulting 
from the first function; and 

(g) obtain as inputs for the second function a statement-to-statement mapping 
between (i) a set of overall evaluative or formative statements used to describe the individual 
test-takers' possible scores on the test as a whole, and (ii) a set of skill-appropriate evaluative or 
formative statements; and 

wherein the computer is adapted to: 

(h) employ the second function to select, based on the inputs obtained in (f) 
and (g), a skill-appropriate evaluative or formative statement to each test-taker's performance on 
each skill assessed on the test. 

33. (New) A system for calculating individual test-takers' growth potential in 
particular skills assessed on a test comprising: 

a data intake module to: 

(a) obtain as inputs for a first function skill-by-skill scores of individual test- 
takers on each of the skills assessed on the test; and 

(b) obtain as inputs for the first function benchmark skill scores of a larger 
group of test-takers on each of the skills evaluated by the test, wherein the larger group includes 
said individual test-takers; and 

a computer coupled to the data intake module wherein the computer is adapted to: 

(c) employ the first function to calculate, based on said inputs, a numerical 
score reflecting each individual test-taker's growth potential in each skill, wherein the first 
function is a non-increasing function of the inputs referred to in (a) and a non-decreasing 
function of the inputs referred to in (b). 
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34. (New) The system according to claim 33 wherein the data intake module is 
adapted to: 

(d) obtain as additional inputs for the first function a quantitative calculation of the 
extent to which each skill was tested on the test, wherein the first function is a non-decreasing 
function of said additional inputs. 

35. (New) The system according to claim 33 wherein the data intake module is 
adapted to: 

(e) obtain as inputs for a second function the numerical scores calculated by 
the first function; and 

(f) obtain as inputs for the second function a score-to-statement mapping 
between (i) the calculated numerical scores and (ii) a set of skill-appropriate evaluative or 
formative statements; and 

wherein the computer is adapted to: 

(g) employ the second function to assign, based on said inputs, a skill- 
appropriate evaluative or formative statement to each test-taker's performance on each tested 
skill based on the test-taker's growth potential in said skill. 



Applicant : David Coleman et al.^^ Attorne^^DocketNo.: 16655-002001 

Serial No. : 10/072,820 

Filed : February 8, 2002 

Page : 14 of 30 



36. (New) A system for assigning an appropriate evaluative or formative statement in 
a skill to a group of test-takers based on their results on a test, the system comprising: 

a data intake module to: 

(a) with respect to a single skill, obtain as inputs all assignments of evaluative 
or formative statements for individual test-takers based on their results on the test; and 

a computer coupled to the data intake module wherein the computer is adapted to: 

(b) with respect to that skill, calculate a number of times each evaluative or 
formative statement was assigned to individual test-takers in the group; and 

(c) with respect to that skill, assign to the group the evaluative or formative 
statement assigned to the greatest number of test-takers in the group. 

37. (New) A system for choosing an instructional approach in a skill appropriate for 
a group of test-takers based on results of a test, the system comprising: 

a computer adapted to: 

(a) identify a set of potential instructional approaches in the skill; 

(b) estimate the utility of each identified instructional approach with respect to each 
individual test-taker, based on that test-taker's performance in the skill on the test; and 

(c) determine which of the potential instructional approaches in the skill maximizes 
an aggregated utility of all individual test-takers in the group. 

38. (New) A system for displaying test-takers' results on a test administered during 
the prior instructional timeframe, the system comprising: 

a data intake module to: 

(a) obtain test-takers' skill-by-skill scores or evaluative or formative 
statements with respect to a test that (i) is administered during a given instructional timeframe 
and (ii) assesses a subject in which the # class groupings of test-takers for purposes of instruction 
varies between that instructional timeframe and a next analogous instructional timeframe; 

a display; and 
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a computer coupled to the display and the data intake module, wherein the computer is 
adapted to: 

(b) cause to be displayed on the display skill-by-skill scores or evaluative or 
formative statements with respect to those test-takers, wherein displays of such test-takers are 
organized around class groupings of a next analogous instructional timeframe. 

39. (New) A system for providing results of a group of test-takers with respect to 
multiple skills assessed on a test, the system comprising: 

a display to display the results of the group of test-takers in multiple tested skills, such 
that a single screen on the display includes names of tested skills and corresponding scores or 
evaluative or formative statements reflecting the group's results in each skill; and 

an electronic interface to enable a viewer to select a tested skill from the display and 
thereby view another display of the results of the group of test-takers in a single skill, 

wherein, in response to the viewer's selection, the display displays the results of the 
group of test-takers in the single skill together with a list of test-takers' names and a presentation 
of the scores or the evaluative or formative statements applying to each individual test-taker in 
the skill. 

40. (New) The system according to claim 39 wherein, in response to the viewer's 
selection, the display also includes a presentation of individual test-takers' names, shown in 
subgroups corresponding to the evaluative or formative statement appropriate to each subgroup. 
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41 . (New) The system according to claim 39 wherein the electronic interface enables 
the viewer to select another tested skill and thereby view a display of the results of the group of 
test-takers in a single skill together with a presentation of the scores or the evaluative or 
formative statements applying to each individual test-taker in that skill. 

42. (New) A system for providing results of one or more test-takers with respect to 
multiple skills assessed on a test, together with skill-specific instructional materials appropriate 
to that group of test-takers, the system comprising: 

a display to display the results of one or more test-takers in multiple tested skills, such 
that a single screen on the display includes names of tested skills and corresponding scores or 
evaluative or formative statements reflecting the test-takers' aggregate results in each skill; and 

an electronic interface to enable a viewer of the display to select a tested skill and thereby 
view instructional materials relevant to that skill. 

43. (New) The system according to claim 42 wherein the instructional materials 
include instructional materials of a difficulty level appropriate to the test-takers based on their 
performance on the test. 

44. (New) A system for providing results of one or more test-takers with respect to 
skills assessed on one or more multi-skill tests, enabling the administration of skill specific 
assessments, and displaying the results thereof, the system comprising: 

(a) a display to display the results of one or more test-takers in multiple tested skills on a 
single test, such that a single screen on the display includes names of the tested skills and, for 
each skill, corresponding scores or evaluative or formative statements reflecting the test-takers' 
aggregate results in that skill; and 

(b) an electronic interface to enable a viewer of the display to: 

(i) select a tested skill and thereby view one or more assessments specific to that 

skill; 
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(ii) choose an assessment specific to the selected skill; 

(iii) distribute, to one or more of the test-takers, the chosen assessment; 

(iv) collect results of the chosen assessment specific to the selected skill, for one 
or more of the same test-takers; and 

(v) choose, from a single screen on the display, to view (i) displays of test- 
takers' results in a given skill based on one or more multi-skill tests or (ii) displays of test-takers' 
results on one or more assessments specific to the selected skill, wherein each of the displays 
includes a list of test- takers' names and a presentation of the scores or the evaluative or 
formative statements applying to each individual test-taker in that skill 

45. (New) A system for providing results of a group of test-takers with respect to 
multiple skills assessed on a test, the system comprising: 

a display to display overall results of the group of test-takers on the test, such that a single 
display includes multiple test-takers and corresponding overall scores in the test for each 
individual test-taker; and 

an electronic interface to enable a viewer to select an individual test-taker and thereby 
view a display of that test-taker's results in multiple tested skills; 

wherein, in response to the viewer's selection, the display displays an individual test- 
taker's results in multiple tested skills, wherein the display includes multiple tested skills with 
corresponding scores reflecting the test-taker's performance in each tested skill 

46. (New) The system according to claim 45 wherein, in response to the viewer's 
selection, the display displays multiple tested skills with corresponding evaluative or formative 
statements reflecting the test-taker's performance in each of the tested skills. 

47. (New) An article for processing and displaying test results of one or more tests 
taken by a plurality of test-takers, the article comprising a computer-readable medium storing 
computer-executable instructions that, when applied to a computer system, cause the computer 
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system to: 

(a) obtain, with respect to each such test, the test itself, said test having a plurality of 
items; and 

(b) obtain item responses of test-takers taking such test; 

(c) determine appropriate skill categories necessary for a correct response for each of 
said items; 

(d) assess the extent to which each item on the test assesses one or more of the skills 
determined in (c) ; and 

(e) calculate a score for each student's performance in each of said skill categories. 

48. (New) The article of claim 47 wherein the medium includes instructions for 
causing the computer system to calculate the scores of a group within skill categories, said group 
defined as a plurality of test-takers. 

49. (New) The article of claim 48 wherein the medium includes instructions for 
causing the computer system to generate evaluation and formative statements for individual test- 
takers and groups. 



50. (New) The article of claim 49 wherein the medium includes instructions to cause 
the computer system to organize instructional material based on the content of the test. 

51. (New) The article of claim 50 wherein the medium includes instructions to cause 
the computer system to display test results and instructional material to individuals. 

52. (New) An article for generating evaluative or formative statements for individual 
test-takers with respect to skills assessed on a test, the article comprising a computer-readable 
medium storing computer-executable instructions that, when applied to a computer system, cause 
the computer system to: 
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(a) obtain as inputs for a first probabilistic function the test-takers' overall scores on 
the test as a whole; 

(b) obtain as inputs for the first function a set of skills assessed on the test; 

(c) obtain as inputs for first function the test-takers 5 skill-by-skill scores on each skill 
assessed on the test; and 

(d) obtain as inputs for the first function a score-to-statement mapping between (i) 
individual test-takers' possible scores on the test as a whole, and (ii) a set of overall evaluative or 
formative statements used to describe individual test-takers' overall performance on the test as a 
whole; and 

(e) employ the first function to select, based on the inputs obtained in (a) through (d), 
one of the overall evaluative or formative statements to describe each test-taker's performance 
on each skill assessed on the test. 

53. (New) The article according to claim 52 wherein the medium includes 
instructions for causing the computer system to: 

(f) obtain as inputs for a second function the overall evaluative or formative 
statements describing each test-taker's performance on each skill assessed on the test, resulting 
from the first function; 

(g) obtain as inputs for the second function a statement-to-statement mapping 
between (i) a set of overall evaluative or formative statements used to describe the individual 
test-takers' possible scores on the test as a whole, and (ii) a set of skill-appropriate evaluative or 
formative statements; and 

(h) employ the second function to select, based on the inputs obtained in (f) and (g), a 
skill-appropriate evaluative or formative statement to each test-taker's performance on each skill 
assessed on the test. 

54. (New) An article for calculating individual test-takers' growth potential in 
particular skills assessed on a test, the article comprising a computer-readable medium storing 
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computer-executable instructions that, when applied to a computer system, cause the computer 
system to: 

(a) obtain as inputs for a first function skill-by-skill scores of individual test-takers on 
each of the skills assessed on the test; and 

(b) obtain as inputs for the first function benchmark skill scores of a larger group of 
test-takers on each of the skills evaluated by the test, wherein the larger group includes said 
individual test-takers; and 

(c) employ the first function to calculate, based on said inputs, a numerical score 
reflecting each individual test-taker's growth potential in each skill, wherein the first function is 
a non-increasing function of the inputs referred to in (a) and a non-decreasing function of the 
inputs referred to in (b). 

55. (New) The article according to claim 54 wherein the medium includes 
instructions to cause the computer system to: 

(d) obtain as additional inputs for the first function a quantitative calculation of the 
extent to which each skill was tested on the test, wherein the first function is a non-decreasing 
function of said additional inputs. 

56. (New) The article according to claim 54 wherein the medium includes 
instructions to cause the computer system to: 

(e) obtain as inputs for a second function the numerical scores calculated by the first 
function; 

(f) obtain as inputs for the second function a score-to-statement mapping between (i) 
the calculated numerical scores and (ii) a set of skill-appropriate evaluative or formative 
statements; and 

(g) employ the second function to assign, based on said inputs, a skill-appropriate 
evaluative or formative statement to each test- taker's performance on each tested skill based on 
the test-taker's growth potential in said skill. 
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57. (New) An article for assigning an appropriate evaluative or formative statement 
in a skill to a group of test-takers based on their results on a test, the article comprising a 
computer-readable medium storing computer-executable instructions that, when applied to a 
computer system, cause the computer system to: 

(a) with respect to a single skill, obtain as inputs all assignments of evaluative or 
formative statements for individual test-takers based on their results on the test; and 

(b) with respect to that skill, calculate a number of times each evaluative or formative 
statement was assigned to individual test-takers in the group; and 

(c) with respect to that skill, assign to the group the evaluative or formative statement 
assigned to the greatest number of test-takers in the group. 

58. (New) An article for choosing an instructional approach in a skill appropriate for 
a group of test-takers based on results of a test, the article comprising a computer-readable 
medium storing computer-executable instructions that, when applied to a computer system, cause 
the computer system to: 

(a) identify a set of potential instructional approaches in the skill; 

(b) estimate the utility of each identified instructional approach with respect to each 
individual test-taker, based on that test-taker's performance in the skill on the test; and 

(c) determine which of the potential instructional approaches in the skill maximizes 
an aggregated utility of all individual test-takers in the group. 

59. (New) An article for displaying test-takers' results on a test administered during 
the prior instructional timeframe, the article comprising a computer-readable medium storing 
computer-executable instructions that, when applied to a computer system, cause the computer 
system to: 

(a) obtain test-takers' skill-by-skill scores or evaluative or formative statements with 
respect to a test that (i) is administered during a given instructional timeframe and (ii) assesses a 
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subject in which the class groupings of test-takers for purposes of instruction varies between that 
instructional timeframe and a next analogous instructional timeframe; 

(b) display skill-by-skill scores or evaluative or formative statements with respect to 
those test-takers, wherein displays of such test-takers are organized around class groupings of a 
next analogous instructional timeframe. 

60. (New) An article for providing results of a group of test-takers with respect to 
multiple skills assessed on a test, the article comprising a computer-readable medium storing 
computer-executable instructions that, when applied to a computer system, cause the computer 
system to: 

display the results of the group of test-takers in multiple tested skills, such that a single 
screen on the display includes names of tested skills and corresponding scores or evaluative or 
formative statements reflecting the group's results in each skill; and 

enable a viewer, by using an electronic interface, to select a tested skill from the display 
and thereby view another display of the results of the group of test-takers in a single skill, 

display the results of the group of test-takers in the single skill together with a list of test- 
takers' names and a presentation of the scores or the evaluative or formative statements applying 
to each individual test- taker in the skill. 

61. (New) The article according to claim 60 wherein the article includes instructions 
to cause to be displayed, in response to the viewer's selection, a presentation of individual test- 
takers' names, shown in subgroups corresponding to the evaluative or formative statement 
appropriate to each subgroup. 
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62. (New) The article according to claim 60 wherein the article includes instructions 
to enable the viewer to select another tested skill using the electronic interface and thereby view 
a display of the results of the group of test-takers in a single skill together with a presentation of 
the scores or the evaluative or formative statements applying to each individual test-taker in that 
skill. 

63. (New) An article for providing results of one or more test-takers with respect to 
multiple skills assessed on a test, together with skill-specific instructional materials appropriate 
to that group of test-takers, the article comprising a computer-readable medium storing 
computer-executable instructions that, when applied to a computer system, cause the computer 
system to: 

display the results of one or more test-takers in multiple tested skills, such that a single 
screen on the display includes names of tested skills and corresponding scores or evaluative or 
formative statements reflecting the test-takers' aggregate results in each skill; and 

enable a viewer to select a tested skill, by using an electronic interface, and thereby view 
instructional materials relevant to that skill. 

64. (New) The article according to claim 63 wherein the instructional materials 
include instructional materials of a difficulty level appropriate to the test-takers based on their 
performance on the test. 

65. (New) An article for providing results of one or more test-takers with respect to 
skills assessed on one or more multi-skill tests, enabling the administration of skill specific 
assessments, and displaying the results thereof, the article comprising a computer-readable 
medium storing computer-executable instructions that, when applied to a computer system, cause 
the computer system to: 

display the results of one or more test-takers in multiple tested skills on a single test, such 
that a single screen on the display includes names of the tested skills and, for each skill, 
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corresponding scores or evaluative or formative statements reflecting the test-takers' aggregate 
results in that skill; 

select a tested skill and thereby view one or more assessments specific to that skill; 
enable a viewer to choose an assessment specific to the selected skill by using an 
electronic interface; 

enable the viewer, by using the electronic interface, to distribute, to one or more of the 
test-takers, the chosen assessment; 

enable the viewer, by using the electronic interface, to collect results of the chosen 
assessment specific to the selected skill, for one or more of the same test-takers; and 

enable the viewer, by using the electronic interface, to choose, from a single screen on the 
display, to view (i) displays of test-takers' results in a given skill based on one or more multi- 
skill tests or (ii) displays of test-takers' results on one or more assessments specific to the 
selected skill, wherein each of the displays includes a list of test-takers' names and a presentation 
of the scores or the evaluative or formative statements applying to each individual test-taker in 
that skill. 

66. (New) An article for providing results of a group of test-takers with respect to 
multiple skills assessed on a test, the article comprising a computer-readable medium storing 
computer-executable instructions that, when applied to a computer system, cause the computer 
system to: 

display overall results of the group of test-takers on the test, such that a single display 
includes multiple test-takers and corresponding overall scores in the test for each individual test- 
taker; 

enable a viewer, by using an electronic interface, to select an individual test-taker and 
thereby view a display of that test-taker's results in multiple tested skills; and 

in response to the viewer's selection, display an individual test-taker's results in multiple 
tested skills, wherein the display includes multiple tested skills with corresponding scores 
reflecting the test-taker's performance in each tested skill. 
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67. (New) The article according to claim 66 wherein the medium includes 
instructions to cause the computer system, in response to the viewer's selection, to display 
multiple tested skills with corresponding evaluative or formative statements reflecting the test- 
taker's performance in each of the tested skills. 



